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constraints: the total power constraint and the interference-to-signal ratio (ISR) constraint, in which 
■ the ratio between the accumulated interference and the received signal power at each PU should not 

exceed certain threshold. Firstly, we focus on the single-PU and multi-SU scenario. Based on the 
" analysis of the Stackelberg Equilibrium (SE) for the proposed Stackelberg game, an analytical hierarchic 

power allocation method is proposed when the PU can acquire the additional information to anticipate 
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SUs' reaction. The analytical algorithm has two steps: 1) The PU optimizes its power allocation with 
considering the reaction of SUs to its action. In the power optimization of the PU, there is a sub-game for 
power allocation of SUs given fixed transmit power of the PU. The existence and uniqueness for the Nash 
Equilibrium (NE) of the sub-game are investigated. We also propose an iterative algorithm to obtain the 
NE, and derive the closed-form solutions of NE for the perfectly symmetric channel. 2) The SUs allocate 
the power according to the NE of the sub-game given PU's optimal power allocation. Furthermore, we 
design two distributed iterative algorithms for the general channel even when private information of the 
SUs is unavailable at the PU. The first iterative algorithm has a guaranteed convergence performance, and 
the second iterative algorithm employs asynchronous power update to improve time efficiency. Finally, 
we extend to the multi-PU and multi-SU scenario, and a distributed iterative algorithm is presented. 

Index Terms 

Cognitive radio, hierarchic power allocation, distributed iterative algorithm, Stackelberg game. 

I. INTRODUCTION 

Cognitive radio (CR) technology has gained much attention because of its capability of 
improving the spectrum utilization efficiency [IJ. In CR networks, the CRs transmit in an 
opportunistic way or coexist with the primary systems simultaneously under the constraints 
that the primary systems will not be harmed. 

Due to scarcity of power and hostile characteristics of wireless channels, efficient power 
allocation schemes are necessary for design of high-performance CR networks. Meanwhile, as the 
game theory is suitable for analyzing conflict and cooperation among rational decision makers, 
it has emerged as a very powerful tool for power allocation in CR networks [|2l, [[3l. In the game 
theory based power allocation frameworks, the nodes are modeled as self-interested or group- 
rational players, and compete or cooperate with each other to maximize their utilities by viewing 
the power as the strategies. The cooperative game theoretic approach of optimal power control 
for secondary users (SUs) in CR networks has been proposed in flU; the authors transformed 
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the coupled interference constraints into a pricing function in the objective utility, and then the 
Kalai-Smorodinsky (KS) bargaining solution and the Nash bargaining solution (NBS) of the 
reformulated game were investigated. In [[5]|, a fair local bargaining framework was proposed 
for spectrum allocation, and two bargaining strategies named as one-to-one fairness bargaining 
and feed poverty bargaining were presented. The opportunistic spectrum access problem was 
addressed by utilizing the cooperative game theory in three bargaining solutions were 
compared and analyzed, and a distributed algorithm that can achieve the NBS for the spectrum 
sharing game was presented. In [Tl, the authors investigated the resource allocation in CR 
networks by using the coalitional game theory, and a distributed dynamic coalition formation 
algorithm was proposed. A distributed power control protocol for the secondary network based 
on non-cooperative game was studied in [[8]|. Utilizing the best response, a distributed algorithm 
to obtain the Nash Equilibrium (NE) of the game was developed. Furthermore, based on the 
distributed algorithm, a network protocol for power control was presented. Dynamic spectrum 
sharing with multiple strategic primary users (PUs) and SUs was investigated by using the 
noncooperative game in [9], two cases under complete and incomplete information assumptions 
were discussed. The dynamic power control problem with interference constraints in CR networks 
was studied in [fTOl . By enforcing the interference constraint through pricing, a non-cooperative 
game model was developed. A kind of Generalized Nash Equilibrium (GNE) with the shared 
constraints, named as the interference equilibrium, was investigated. 

The Stackelberg game, which is also referred to as the leader-follower game, is a game in which 
the leader moves first and then the followers move sequentially. The problem is then transformed 
to find an optimal strategy for the leader, assuming that the followers react in such a rational way 



that they optimize their objective functions given the leader's actions [1 IJ. In [fT2|. [fT3l . [[T4|^ 



the 



Stackelberg game was applied for the multi-user power control problem in interference channels. 

'in 1141 . the Stackelberg equilibrium is a special case of the conjectural equilibrium. 
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The Stackelberg game was used for power control in a decentralized multiple access channel 
in [fTSl . Moreover, in lfT6l . it has been proved that compared to the standard non-cooperative 
power control game, the utilization of the Stackelberg game achieves performance improvement 
for both the individual and the global system. Distributed relay selection and power control for 
multiuser cooperative communication networks were addressed in [fTTll . hi ifTSl . the Stackelberg 
game was utilized to study the hierarchical competition in cellular networks that is comprised 
of the macrocells underlaid with femtocells. 

As the Stackelberg game is defined for the cases in which a hierarchy of actions exists 
between players, it is a natural fit for the CR scenario. The Stackelberg game was employed 
to CR networks in [fT9ll . Il20l . A Stackelberg game model was proposed for frequency bands in 
which a licensed user has priority over opportunistic cognitive radios. In [[2T|. the Stackelberg 
game was applied for the utility-based cooperative CR networks. In [22], the resource allocation 
in CR networks was studied by using the Stackelberg game to characterize the asymmetry of 
PUs and SUs. Allocation of under- utilized spectrum resources from PUs to multiple SUs was 
modeled as the seller-buyer game. Similar work can also be found in [|23l though the authors did 
not claim the use of Stackelberg game explicitly. A decentralized Stackelberg game formulation 
for power allocation was developed in [[24l. Distributed optimization for CR networks using the 
Stackelberg game was considered in {25\. Distributed power control method for SUs and optimal 
pricing for PU were obtained, and the algorithm for finding the optimal price was proposed. In 
[|26l . the authors focused on how the SU chooses its power level to obtain maximal cognitive 
network capacity with guaranteeing the performance of the PU. Power allocation in the down- 
link of the secondary system was considered by using the Stackelberg game in [27]. Constraints 
such as protecting PUs and maximum power limitations of base stations (BSs) were considered. 
Distributed power control for spectrum-sharing femtocell networks was investigated by using 
the Stackelberg game in [|28ll . The Stackelberg equilibrium (SE) was studied, and an effective 
distributed interference price bargaining algorithm with guaranteed convergency was presented 
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to achieve the equiUbrium. 

Recently, orthogonal frequency division multiplexing (OFDM) has been recognized as an 
attractive modulation candidate for CR systems. In practice, the efficient algorithm of allocating 
power to sub-carriers in OFDM-based PU network is also important. However, most above 
mentioned works focus on the power control of the SU network, the hierarchic power allocation 
for OFDM-based PU network and SU network by using the Stackelberg game has not been 
extensively studied yet. When the power control for the PU network and SU network are jointly 
considered, we should consider not only the interference among SUs, but also the interference 
among PUs as well as the mutual interference between the PU network and the SU network. To 
meet quality of service (QoS) requirement of the PU precisely, the interference-to- signal ratio 
(ISR), which is defined as the ratio between the accumulated interference and the received signal 
power, should be less than a constant at the PU. Then the power allocation of both PU network 
and SU network are tightly coupled. In addition, the transmission from the primary transmitter to 
its receiver needs to be analyzed. The utility function of the PU takes the transmission merit, such 
as rate, into consideration. Due to the above reasons, the hierarchic power allocation algorithm 
is challenging especially when the PU network cannot acquire private information of the SU 
network. Even when the private information is available, it is difficult to design the time-efficient 
algorithm because of complexity of the game. 

In this paper, the main contributions are summarized as follows: 

• A Stackelberg game is formulated to describe the priority of the power allocation for the PU 
network. We analyze the mutual effect between power allocation for the PU network and 
that of the SU network in two aspects: ISR constraint and mutual interference between the 
PUs and SUs. The former impacts the feasible power allocation set, and the latter influences 
the utility. 

• When there is only one PU, the Stackelberg game can be written as an optimization problem 
that contains a non-cooperative sub-game. The sub-game can be viewed as the power game 
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of the SU network given the PU's power. We analyze existence for the NE of the sub- 
game, and give a sufficient condition of uniqueness. Moreover, an iterative algorithm, which 
converges to the NE, is presented for the general channel condition, and the closed-form 
solutions for the NE are derived in the perfectly symmetric channel. 

• Based on the Stackelberg game analysis, the hierarchic power allocation algorithms for the 
PU network and SU network are proposed. Considering availability of the private informa- 
tion for the SUs at the PU, two scenarios are investigated. When the private information 
is available and the perfectly symmetric channel conditions can be satisfied, the PU can 
allocate power by solving a specific optimization problem and the SU can allocate power 
analytically. Otherwise, the iterative distributed power allocation algorithms are presented. 
We also investigate convergence and effectiveness of the proposed iterative algorithms. 

• The extension to the multi-PU and multi-SU scenario is discussed, and we present an 
iterative distributed algorithm for the hierarchic power allocation. 

The reminder of the paper is structured as follows. In Section II, we introduce the system model 
under consideration, and formulate the Stackelberg game. In Section III, the game analysis is 
performed. In Section IV, the hierarchic power allocation methods for PU and SUs are proposed. 
Next, the numerical results are presented in Section V. We also discuss the extension to the multi- 
PU scenario in Section VI. Finally, we conclude the paper in Section VII. 

II. System model and problem formulation 

A. System model 

We consider a spectrum-sharing scenario in which a PU system coexists with a SU system. The 
PU system consists of a transceiver pair (i.e., PU) using OFDM. The SU system is an OFDM- 
based ad hoc network in which CR transceiver pairs (i.e., SUs) can simultaneously transmit with 
the PU. The PU is denoted as user 1 and the SUs are denoted as user 2,- • • , user L, respectively, 
i.e., the PU set P = {1} and the SU set S = {2, • • • , L}. It is assumed that the total number 
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of OFDM sub-channels is N, and each sub-channel experiences flat fading. The sampled signal 
on the /-th sub-channel at user j is = \fplh^jXj + J2i^jevus \J Pi^ij^l + '^1 ■> where P- 
and hlj denote the transmitted power of user j and the channel coefficient between transmitter 
of user i and receiver of user j on the /-th sub-channel, respectively, xj is the transmitted 
symbol of user j at sub-channel / and is assumed to have unit energy, wl is the additive 
white Gaussian noise (AWGN) with wl ~ CAf{0, N/). Each user has a limited power budget, 
i.e., J2^=i Pj — Pp^"^, Vj G P U S. Treating the interference as noise and assuming Gaussian 
signalling, the maximum rate that user j can obtain on the /-th sub-channel can be expressed 



as = log 1 + ^'Xf P+iv/ (nats/s/Hz). 

B. Stackelberg game formulation 

We formulate the PU as the leader and the SUs as followers. The PU first selects its trans- 
mission power by maximization of its utility, in which it tries to anticipate the SUs' reactions to 
its action. And then, based on the PU's power, the SUs compete with each other to maximize 

its own rate by adjusting transmit power. The ISR constraint, 'tS, / .2^ < P with p being the 

1^1, il 

ISR threshold, needs to be satisfied to guarantee primary service^. 

Given the PU's transmit power, the SUs' non-cooperative sub-game can be mathematically 
formulated as = {^l, {Si}-^^ , {ui}^^^} , where 1] = S is the set of active players. The set of 
admissible power allocation strategies for user i is given by Si = jPj = {Pl,Pf, ■ ■ ■ ,P^) : 
E7=i p! < Pr""-^ V/ G {1, 2, ■ ■ ■ , AT}, i^-^ > o|. The utility function of user i is defined as 
Ui (P„ P_,) = Ell ^ftl where P_, := {P^} 



fcGn/{i}- 



^ We only need to guarantee that the power allocation in the stable state, i.e., the Stackelberg equilibrium (its definition will 
be given in the following) or the convergent outcomes of the iterative algorithm, should satisfy the ISR constraint. 

^The utility function can be defined in other forms, i.e., the proposed framework is general enough to allow different definitions 
of the utility function, concerning the obtained conclusions, some are independent on the utility function definition and others 
can be adapted easily for new definitions of the utility function. 
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For the PU, if it can anticipate SUs' reactions to its action, we have the following problem 

where Pi = (P^, Pf, ■ ■ ■ , P^), P* = (P/*, Pf\ ■■■ , Pf*) with i e Q, and (P*, P*_J is the 
NE of ^ when Pi is giveiH 



III. Game analysis 

In this section, the existence, uniqueness, and solution for the NE of the sub-game Q are 
analyzed. An iterative algorithm to obtain the NE of the sub-game is given. We also investigate 
the convergence of the iterative algorithm. Furthermore, the closed-form solutions for the NE 
are derived for the perfectly symmetric channel. 

First, for sub-game Q, its NE is defined as as follows: 

Definition 1. (P*, P%) is the NE if m (P*, P*_i} > Ui (P^, P*_,) for all P, G 5, and i e Q. 

With respect to the existence of the NE for Q, we have the following proposition. 

Proposition 1. The sub-game Q has at least one pure NE. 

Proof: Due to the page limitation, we give the sketch of proof. First, VP, P' G Si, we have 
aP + (1 - a)P' eSiiae [0, 1]), i.e.. Si is a convex set. Meanwhile, as P^;'^^^ < cx), 5^ C 
is closed and bounded, so it is compact. Next, Ui (Pi, P_j) is continuous in P_j. Vr G R, we 
can prove that the upper contour set = {Pi G Si, Ui {Pi, P-i) > t} is convex. Consequently, 

''The definition of NE will be given in the following Section. ([TJ is the formulated Stackelberg game, where it contains the 
sub-game Q. We should observe that the ISR constraint is not considered in Q. But as the ISR constraint is considered in (Til, 
the solutions of the Stackelberg game comply with the ISR constraint. 
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Ui (Pj, P_j) is quasi-concave in Pj. Using the Debreu-Fan-Glicksberg theorem [29.1 . the lemma 
can be proved. ■ 
The uniqueness of the NE can be given by 

Proposition 2. Define 

Mi.= { I ' J (2) 



« = J. 



If M is a positive definite matrix, Q has a unique NE. 



Proof: Define Aj (P) = — Vp^Wj (Pj, P-j) with Vp. (■) being the gradient vector with 
respect to Pj, and denote S = S2 x ■ ■ ■ x ^^i^i+i with a Cartesian structure. When M is a 
positive definite matrix, VP = (P2, ■ ■ ■ , P|q|+i), P' = (P'2, ■ ■ ■ , P^l+i) ^ <S, 3 a > such 
that maxi^n {{Pi - P'i) [Aj (P) - Aj (P')]} > a||P - P'\\l, where ||.||2 is the spectral norm. 
Consequently, Q has a unique NE [|30l . [1311 . ■ 
Remark: The conditions in Proposition |2] can be viewed as the weak interference condition 
i'mce — f — f, f ,„ ana ^ — ^ — ' , f ,f — - — - — denote the interference level. 

N'.+Pl\h[^\^ I /if. 1 2 J 

In the following, we give an iterative algorithm to obtain the NE. The best response for user 
i {i eVI) can be expressed as 

P/ = BR, (P/, pL,) = [ \h 2 ' 

where Pl^ik) = |p/ (k)] , (■)+ = max(-, 0), /i^ is a constant satisfying Y.^. P/ < i^"'^^. 
I J jen/i •' 

Based on ([3]), an iterative distributed algorithm (Algorithm 1), which can converge to the NE, 
can be given. 

In the algorithm, SU i only has to obtain its own channel state, ha, and measure the aggre- 
gated interference it received, P/|/i{ jP + J^jen/iPj (^)l^iiP' therefore it can be implemented 
distributively. 
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Following the existing literature (such as I fTOll . [[331 ). sufficient conditions for the convergence 
of Algorithm 1 can be given by the following proposition. 

Proposition 3. Define c{j = \h{j\y\hlj\\ [C^],_i,,_i = c{j, i ^ j e Vl, and [C%,, = 0. If 
V/ G [I,-- - ,A^], IIC-^II < 1, where ||.|| is any induced matrix norm with its corresponding 
vector norm being monotone, Algorithm 1 converges. 

Proof: Please refer to [[TOl . [[33l . The proof is omitted due to the page limitation. ■ 
Under a special circumstance, i.e., perfectly symmetric channel, we derive the closed-form 
solutions of NE. 

Proposition 4. When \hi,\/Wj = < 1, iV//l4l' = ^/I^^J/ and = 

\h{j\/\h^jj\ for f, f = 1, ■ ■ ■ , N and i ^ j e Q, the perfectly symmetric channel conditions hold. 
Then, for L = 3, the NE of Q has the following closed- form solution 



pf* 

-'2 



1+c 



fe[h + l,h]; 
fe[h + l,N], 



(4) 



p/* 

^3 



1+c 



fe[l,k2]; 
fe[h + l,N], 



(5) 



where c = |^^/|/^{,r^ aj = (n/ + P{\h{f) \h{t^ t; = k^' 



max I \ ^ ^2 
3 



e£i 



^Without loss of generality, we assume p™^^ > pm^x ^^^^ distinguished by the number of sub-channels in perfectly 

symmetric channel, the sub-channels can be re-numbered according to the strength of received PU'interference plus noise. Thus, 
it is also assumed that cri < a2 < • ■ • < ajv. Sub-carriers should be re-numbered at the beginning, and we need to recover the 
number of sub-carriers in the final. 
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where k2 can be found from (fl < p™^^ < , i with 



TTcT^lii^k-a,), l<k<N- 



(6) 



oo, 



k = N + 1. 



t 



1 ~ fci 

solution of ip\^ < P^^"^ < (pl^_^'^ and (fl is defined as 



, where ki = k2 when p™^^ < (pl.,^_^_-^^; Otherwise, ki is the 



Etfe+i(^fc - ^i) + TT^ E?=i ((1 + c)crk 



1 



<^fc=^ -a,- ct;j,k e[k2 + l,N]; 
oo, A; = A^ + 1. 



(7) 



Proof: Let be the cardinality of the set fi. Since Ui (Pj,P_j) is concave on Pj, using 
the KKT conditions [32], (P2, ■ ■ ■ , P[n|+i) is the NE if and only if there are non-negative {/ij} 
satisfying 



dui (Pi, P_,,, 



dP/ 



pf ^ Ni + Pj\hl\^ ^ E^.enPl\h^^ 



-\ -1 



\h: 



f\2 



Pf + a^ + cY P. 



-1 I = /i„ P/ > 0; 



(8) 



(9) 



Consequently, let = ^ 
of the form as 



i_ ( i+i\n\-i-r+k)c _ 1. 1 ^ith Ai < • ■ ■ < A|oi, each NE is 



pf 

fc+i 



1 



\n\ ' 



(10) 
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For user (|Q| + 1), we have 



When the equahty holds, we have r^^^ — , where k\ii\ is given by 

</'Vi < Pm^i < </'vi+i and 0^ = i+Qn\-i)c E/=i(^fc - Consequently, the equilibrium 
power allocation for user + 1) is given by 



,/* _ J i+(|n|-i)c ' / ^ [I'^lf^L 

0, fe[k\ni + l,N]. 



P{nU-< (12) 



|f^|-l _ l+m-l)c \n\-l _ \n\ , retrarHinP user lOI 

- i+(|n|-2)c^|n| i+{\n\-2)c^\a\' ^^^^ regaramg user \\t\. 



+ 1 + {\n\ - 2)C ^rl,"l<./<rp- Vl^l - • 



(13) 



utilizing .he equality, we ge.rgl-'- ^ (pgp + + ^ ".'^^ -IZ^j) (i^) . 

where A;|f2|_i is derived by 



<^V;\ < ^l^r ^ '^K+i' otherwise. 



(14) 



with 



"Pk - 2^f=k^,,^+i 1 + - 2)c ^/=i 1 + - 2)c 
" ( l + (M-2)c "^ - + 1 + (|Q|-2)> I 1 • 
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Then 




,{|n|-i). 



i+(|n|-2)c+°"/ 

i+(|n|-i)c ' 



/ e [l,k\n\]; 

f e [k\n\ + i,^|Q|-i]; 



= < 



(16) 



f e[k\n\-i + l,N]. 



As = 2, we arrive at the proposition, which completes the proof. 



Remark: The above proposition is for the 2-SU scenario, however, following the proof of 
this proposition, the closed-form solutions for the multi-SU scenario can be obtained similarly. 
Using Proposition |?] the power for SUs in the perfectly symmetric channel can be allocated 
analytically with simple computation. Moreover, if we suppose that {Pl^^^}ien is known at user 



interference from PU, P/ Thus Proposition^ can be distributively applied. 

Equations © and ^ as well as Algorithm 1 can be used to obtain the NE of Q in the 2-SU 
scenario. When the perfectly symmetric channel conditions hold, the analytical solutions are 
given in @) and Q; Otherwise, Algorithm 1 can find the solution for the general case. 



In this section, we consider the hierarchic power allocation for the PU and SUs. If the PU 
can acquire the additional information about the SUs to anticipate SUs' reactions to its action, 
we propose an analytical power allocation algorithm. Otherwise, the iterative power allocation 
algorithms are developed. 

A. Analytical power allocation algorithm 
The definition of the SE is given by 

Definition 2. (P];,P*,Plj) is a SE for the proposed Stackelberg game when it satisfies 



i (i G Q), user i (i E Vt) only needs to obtain c (i.e. hj- and h{j and measure the received 



IV. Power allocation algorithm 
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2) ui > ui (Pi,P*,Pli) for any feasible Pi. 



Remark: In the definition, inequality 1) implies that (P*,Plj) is the NE of Q given P^ As 
(P*, P%) denotes the NE of G given Pi, we have an equivalent definition: (PJ, A^e(P^)) is a 
SE ifui {PI, A^e(P^)) > ui (Pi, A^e(Pi)) for any feasible Pi, where Ne{x) denotes the NE of 
Q given Pi = x. 

The following lemma gives the solution of the SE for the proposed Stackelberg game. 

Lemma 1. The SE of the proposed Stackelberg game can be obtained as follows: 1) Solving 
© to obtain P*. 2) Let Pi = P*, solving the NE of Q, (P*, PlJ. Then, (P*, P*, PlJ is a SE. 

Proof: (P*, P*_j) is the NE solutions of Q given P\, so we have 

(Pt, P*, PI,) > (Pt , P„ PI,) , Vz G 1], P, G S,. (17) 
Furthermore, since PJ is the optimal solution of ([U), then 

ui {P\, P*, PI,) = ui (Pt, Ne{P\)) > ui (Pi, iVe(Pi)) = (Pi, P*, PI,) (18) 

for any feasible Pi. Combing (fTT] ) and (fTSl ). we claim that (PJ, P*, PI,) is a SE, which competes 
the proof. ■ 
Based on Lemma [H we get the analytical power allocation method. First, the PU obtains the 
optimal power allocation, P^, by solving ([U). Then, SUs allocate the power according to the 
NE of Q, (P*, Plj), given Pi = P*. For the 2-SU scenario with perfectly symmetric channels, 
substituting dU and (|5]) into ©, the PU problem becomes a convetional non-convex optimization 
problem. By solving the problerqj, we obtain the optimal power allocation strategy of PU, Pi. 
Replacing Pi by P^ in dH) and ©, we get the NE of Q given the optimal power allocation of 

•^The PU should know c, h{^, h{^, h{-^, P™'"" (i G f^, / = 1, ■ • • , A'') and its own channel state to solve the problem 
numerically. 
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PU, denoted by (P2,P3). Then, SUs allocate the power according to and P3, respectively. 
Observe that (PJ,P2,P3) is the SE of the Stackelberg game according to Lemma [U 

B. Iterative power allocation algorithm 

If the private information of the SUs is unknown to the PU, the PU cannot set an optimal 
power level by solving the non-convex optimization problem even under the perfectly channel 
conditions in Proposition IH Alternatively, the iterative algorithms are needed to identify the 
power level. 

The outcomes of the iterative algorithms are not the SE solution. To play SE, the PU must 
have the ability to anticipate the SUs' reactions to its action. However, it is impossible to exactly 
anticipate the SUs' reactions to the PU's action when the PU cannot obtain the private information 
about the SUs. The PU should know the SUs' private information such as the strategy set (please 
refer to footnote 6 to find the exact information needed) to anticipate the SUs' reactions to its 
action. Although SE can be viewed as a special case of conjectural equilibrium (CE) lfT4ll . CE 
assumes that the foresighted user knows its stationary interference and the first derivatives with 
respect to the allocated power (ISR constraint is not considered in [14]). Hence, no algorithms 
can derive the SE solution in the case that the PU cannot obtain the private information about 
the SUs, especially when the ISR constraint is considered. 

The PU sets an initial power level in Step 1. In each iteration, based on PU's power allocation 
in the former iteration, SUs allocate their power levels {Pi{n) = (^Pl{n), ■ ■ ■ , Pf{n)) } .^^ ac- 
cording to the NE of the SUs' sub-game by using Proposition!?] or Algorithm 1. Given the novel 
power levels of the SUs, the PU updates its power by maximizing its utility under total power 
and interference constraint^ i.e., P{{n + 1) is the solution of the following convex optimization 

'please refer to (TJ. To some extent, the ISR constraint is imposed on PU network in the iterative algorithm. In 1281 , the 
interference constraint has been imposed on PU to decrease the complexity of the power allocation algorithms. Here we impose 
ISR constraint on PU network for the similar reason. 
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problem, 



IX Ml = y " log 1 1 + ^^^^^'^^ , 1 (19) 



s.t.j:^^^P/<P-P/>0,-^^<P, 
where /-^(ra) = Xlies -^/(^)l^fil^ '•^^ received interference at the PU. The ISR constraint 



ff < p in (fT9l ) is equivalent to a minimal power constraint ^f*^]^ < P/ 



it can be solved by a 2-step algorithm. The minimal power to meet the ISR constraint is first 
allocated to each sub-channel, i.e., we allocate ^/f'^]^ for sub-channel /; Then, subtracting the 
allocated power from p™^^ and allocating the remaining power to the sub-channels by using 
water-filling method. The iteration continues until convergence. We observe that the PU only 
needs to know its own channel information, h(^, and the received interference, P {n). The specific 
distributed power allocation algorithm is described in Algorithm 2. 

Remark: When the private information of the SUs (followers) cannot be acquired by the PU 
(leader), the PU has no information at the beginning and it cannot anticipate the interference 
from the SUs with respect to its own power allocation, the only thing it can do is to randomly set 
an initial feasible power allocation. Then according to the PU's power allocation, the SUs play 
their sub-game to obtain the power allocations. Next, define the n-th (n = 1, 2...j round as "the 
PU allocates its power Pi(n), and the SUs allocate the power {Y*i{n)\i G Vt] subsequently" . In 
the n-th round, the PU can only know the interference of the SUs with respect to the PU's former 
power allocation (power allocation in the former round), i.e., P{n — 1) (history information of 
the interference and can be obtained by measuring the total interference it received), it cannot 
exactly anticipate the interference of the SUs with respect to the PU's allocation in the same 
round, i.e., P [n) (future information of the interference), so it can only allocate the power by 
utilizing the history information P{n — 1). Then, based on the PU's power allocation, the SUs 
play their sub-game to obtain the power allocations in the same round. In addition, the ISR 
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constraint should be considered in the power allocation. 

Due to the condition that the PU cannot obtain the private information about the SUs, 
the PU cannot exactly anticipate the future information of the interference and it can only 
utilize the history information of the interference. In conclusion, the unavailability of the private 
information and the ISR constraint lead to Algorithm 2. There are many methods to utilize the 
history information, we choose the simplest one in our algorithm. 

Regarding the convergence of Algorithm 2, we have the following lemma. 



Lemma 2. When P^^"^, hij, and Ni G § U P) are fixed, there exists a constant ^ > 0, and 
when 77 < ^, Algorithm 2 converges. 



Proof: Denote 



x(PiH) 



n) 



+ A 



If{n) + N(^ 



N 



/=1 



where 



1=1 



{xi, ■ ■■ ,Xn). Then 



Pi(n + 1) = (1 - r/)PiH + rixiPiin)) := F (Pi(n)) . 



(20) 



First, VP^^^ ^ Pf ^ in PU's feasible power set, as XlJLi ^1 ^ ^t""''' for i G P U §, 3 /3 > 



satisfies 



,(1) 



(21) 



^Based on the history information of the interference, the PU may predict the future information of the interference by using 
prediction methods, but it is not exact prediction. 
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Next, from (|20l ). we get 



p(i) _ p(2) I p I pv^; ) - F ( Pi' 



.(1) 



,(2) 



+ r/(Pl^)-PfM x(Pr)-x(Pr) > [l-(l + /3)r7]||Pr^-Pi■ 



,(l) 



(2)^ 



T (a) 



T3(2)||2 



125 



(22) 



where (a) holds since On the other hand, 3 ^ > 0, ||x(PS^Vx(Pf^)ll2 < ^HPS^^-PS^^Ib- 
Consequently, we derive 



p(l) _ pv-; I p / pu; ) _ F ( Pi' 



,(2) 



>(1) 



,(2) 



> (l-(l + /3)ry)r2||;^(pW)-;^(pf 



(23) 



When 7] < [1 + (3) ^, F(-) is co-coercive with constant [1 — (1 + /3)r]]9 ^. Then, applying Th. 
12.1.8 in [[301, if r] < 2[1 - (1 + /3)r/]^"^ i.e., r] < 2[2(1 + /3) - e^]-\ the iterative algorithm 
converges. In conclusion if r] < min{(l + /3)"^2[2(1 + /3) - 6*^]"^} = (1 + := 6 the 
iterative algorithm converges, which completes the proof. ■ 

Remark: The upper bound of convergent step-size for Algorithm 2 is fixed. If the algorithm 
does not converge with a certain step-size, we can choose smaller step-size to make the algorithm 
converge. Lemma |2] guarantees the existence of such convergent step-size. 

In [[T4|. conjecture-based rate maximization (CRM) algorithms are developed even if the 
foresighted user has no a priori knowledge of its competitors' private information. The CRM 
algorithm can achieve better performance than NQ^- However, there are shortcomings of CRM 
algorithm: 1) It is not guaranteed to converge to a CE. 2) It cannot be utilized for the scenarios in 
which multiple foresighted users coexist. 3) The number of frequency bins should be sufficiently 
large. In contrast, there are no constraints on the number of frequency bins in our proposed 
algorithm, and it has guaranteed convergence performance. Moreover, our proposed algorithm 
can be extended to the multi-leader case (see Section VI). Finally, no ISR constraints are 

'observe that the CRM algorithm cannot derive the SE. 
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considered in lfT4]i^" 



As explained in the paper, the ISR constraint will greatly couple the power 
allocations of the PU (leader) with the power allocations of the SUs (followers). That is to say, 
the CRM algorithm cannot be applied under our system model, where the ISR constraint should 
be considered. In a word, we deal with a more complicated problem in this paper. 

In Algorithm 2, the PU waits for the convergence of the power profiles of the SUs (Step 2), it 
then updates its power. It will be time-consuming especially when the number of SUs is large. 
For the purpose of further improving time efficiency, we propose the asynchronous algorithm in 
Algorithm 3. 

Remark: The PU asynchronously updates its power allocation in Algorithm 3. It does not need 
to wait for the convergence of SUs ' power allocation. Consequently, it is more time-efficient. 

V. Numerical results 

In this section, we perform simulations to verify our analysis. The convergence of the iterative 
algorithm as well as the rate performance for analytical and iterative algorithms are given numer- 
ically in this section. In the simulation, the channel coefficients are modeled as independently 
circular symmetric Gaussian distributed random variables for the convenience of illustration. We 
also assume that the channels do not change during one implementation of the algorithm and 
"average"(e.g., average power, average rate) is taken over 10^ channel realizations. 

First, we compare the analytical solutions (0]) and ^ with Algorithm 1 in the perfectly 
symmetric channel case. In the simulations, we set = 3, Pi = [7 1 3], P^^^ = 5, p^ax _ 
N2 = Ns = [0.5 0.5 0.5], /i22 = ~ CA/'(0, [1 1 1]), hu = ~ CAT (O, [v^ Vo^ VOA]), 
and = h^2 = 0.5 x (i-C-, c = 0.25). Using dH) and (HO we obtain the average NE 
power P* = [1.4242 2.0709 1.5049], P| = [0.2676 0.4432 0.2892]. Fig. [U shows the results 

'"The system model considered in 1 14| is the interference channel. 

" Sub-carriers should be re-numbered before using ^ and (|5]l, and we need to recover the number of sub-carriers in the final. 
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of Algorithm 1. Observe that Algorithm 1 converges to the same results as analytical solutions 
since the 5-th iteration. 

Next, we evaluate the convergence performance of the iterative hierarchic power allocation 
algorithms. The inner iteration for Algorithm 2 (iteration for Algorithm 1) is set to be 10. Iteration 
denotes the number of the outer iterations in Algorithm 2. In Algorithm 3, we let = 3 x fc. 

On one hand, we evaluate the convergence performance in different channel states with the 
same ISR constraint, the same total power constraints and the same step-size. In the simulations, 
we set iV = 3, iVi = iVa = A/'s = [1 1 1], p = 0.2, Pf'^^ = 15, Pg""^^ = 5, Pf'^'' = 6, and 
step-size S = rj = 0.1. Fig. [21 plots the convergence performance of Algorithm 2 and Algorithm 
3 with different channel parameters. The PU and SUs are uniformly located in a square area of 
10 X 10. The channel gains are generated as hij = d~Jhij, where dij represents the distance 
between the transmitter of User i and the receiver of User j, and a; = 2 is the path loso- It is 
observed that both Algorithm 2 and Algorithm 3 converge to the same results with the channel 
parameters 1 and channel parameters 2, respectively. Algorithm 2 converges since about the 50- 
th iteration, and Algorithm 3 converges since the 100-th iteration. We should notice that there 
are 10 inner iterations in each iteration of Algorithm 2, then Algorithm 3 is more time-efficient. 
Moreover, we can see that the rate performance with the channel parameters 2 is better. This 
can be explained as follows: Comparing the channel parameters used in the simulations, there 
is stronger interference in the channel parameters 1. Then the performance with the channel 
parameters 2 will be better. 

On the other hand, we evaluate the convergence performance in the same channel state with 
different step-sizes. Parameters are chosen as follows: N = 3, Ni = N2 = N3 = [1 1 1], p = 0.1, 
pmax ^ 25, P^^"" = 3, Pg'^^^ = 4, hi2 ~ C^^{0, [0.4 0.5 0.6]), ~ CA/'(0, [0.5 0.5 0.3]), 
h2i ~ C^^{0, [0.6 0.5 0.6]), hi ~ CM{0, [0.7 0.5 0.4]), h23 ~ CA/'(0, [0.5 0.5 0.5]), h2 ~ 

'^a — 2 corresponds to to free-space propagation. 
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CAr(0, [0.5 0.5 0.5]), /in ~ CU{<<), [1 1 1]), /i22 ~ CU{Q, [1 1 1]), /iss ~ CAr(0, [1 1 1]). Fig. |3] 
and Fig. |4] demonstrate the convergence performance of Algorithm 2 with different step- sizes. 
We can observe that the algorithm converges with step-size rj = 0.1. However, when 7] = 0.9, 
the algorithm does not converge, it oscillates. It can be interpreted by using Lemma [21 The 
upper bound for convergent step-size for all channel realizations lies between 0.1 and 0.9, i.e., 
0.1 < min,^ < 0.9, so when r] = 0.1, the condition in Lemma [2] can be satisfied, then the 
algorithm converges for all channel realizations and the average rate converges. When i] = 0.9, 
1] < ^ does not hold, the convergence cannot be guaranteed. Fig. |5] and Fig. |6] illustrate the 
convergence performance of Algorithm 3 with different step-sizes. Similarly, we observe that 
the algorithm converges when the step-size is set to be 0.1, and it oscillates when the step-size 
equals to 0.9. 

In the perfectly symmetric channel, both analytical and iterative power allocation for PU 
and SU can be appliej^. Fig. |7] shows the rate performance of the analytical hierarchic power 
allocation and iterative power allocation for the PU and SUs with different power constraint for 
the PU, P™^^. We can observe that the rate performance of the PU decreases slightly in the 
iterative power allocation because of the unavailability of SUs' private information, but the rate 
performance of the SUs is almost the same as the analytical algorithm. This verifies effectiveness 
of the iterative power allocation. 

VI. Extension to the multi-PU and multi-SU scenario 

When considering the multi-PU scenario, there are multiple leaders in the Stackelberg game, 
they compete with each other to maximize their individual utility. Each PU considers not only 
the power allocation of other PUs, but also the rational reaction of SU network to the power 
allocation of the PU network. And we need to guarantee all PUs' ISR constraints. By minor 
adjustments, the proposed algorithms can be applied in the multi-PU and multi-SU scenario. 

"Analytical method is applied when private information is available, and iterative method is used otherwise. 
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In Algorithm 1, SU i still measure the aggregated received interference, but the interference is 
generated by all PUs and other SUs in this scenario. In Algorithm 2 and Algorithm 3, the update 
of each PU's power can still utilize the former method. But the received interference should take 
other PUs' power allocation into consideration. In Algorithm 2, the convergence of PUs' power 
allocation should be achieved before the next iteration in multi-PU case. A renewed algorithm 
of Algorithm 2 for multi-PU is outlined as Algorithm 4. 

Fig. [U plots the rate performance when there are 2 PUs (user 1 and user 2) and 2 SUs (user 
3 and user 4). In the simulation, the parameters are chosen as follows: = 3, p = 0.1, P™^^ = 
P^^^ = 15, Pg"^^^ = 2, Pf = 6, Ni = N2 = Ns = Ni = [1 1 1], hi2 ~ CA/'(0, [0.5 0.2 0.1]), 
his ~ C^^{0, [0.5 0.5 0.3]), hu ~ C^^{0, [0.4 0.5 0.6]), /lai ~ CA/'(0, [0.1 0.6 0.1]), h23 ~ 
CM{0, [0.5 0.6 0.3]), /i24 ~ CA/'(0, [0.6 0.6 0.5]), hi ~ CM{0, [0.3 0.7 0.2]), /i32 ~ C^^{0, [0.2 0.1 0.5]), 

/i34 ~ c^^{o, [0.6 0.8 0.6]), ~ ca/'(o, [0.4 0.3 0.2]), ^2 ~ ca/'(o, [0.2 0.3 0.3]), hs ~ 
c^^{o, [0.5 0.6 0.7]), hi ~ cM{o, [i 1 1]), h2 ~ ca/'(o, [i 1 1]), hs ~ c^^{o, [0.5 0.5 0.5]), 

h4 ~ CA/'(0, [0.5 0.5 0.5]) and the step-size rji = 0.001 for z G P. The average rate is averaged 
over 10^ channel realizations. From Fig. [8l we can see that the algorithm converges from the 
60-th iteration. 

VII. Conclusion 

We consider the power allocation for the PU network and SU network jointly by using the 
Stackelberg game to describe the hierarchy. The PU network is considered as the leader, and 
the SU network acts as the follower. We consider the ISR constraint to guarantee the primary 
service in the Stackelberg game. Based on the analysis of the Stackelberg game, the hierarchic 
power allocation algorithms are given. Analytical method is presented when PU can obtain the 
information for SU. Once PU cannot obtain the information for SU, distributed iterative methods 
are proposed. 
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Algorithm 1: Iterative Distributed Algorithm 
for Obtaining NE 

Step 1: A; = 0, 

initialize feasible {Pi(0) = (P/(0), ■ ■ ■ ,i^^(0))},. 
Step 2: Pl{k + 1) = BRi (^P{ , PUk)^ 

for every i G and / = 1, ■ ■ ■ , A^. 
Step 3: = /c + 1, go to Step 2 until convergence. 



Algorithm 2: Joint Iterative Distributed Power Allocation 

Algorithm for PU and SUs (single-PU and multi-SU) 

Step 1: n = 0, initialize Pi(0) = (Pi (0), ■ ■ ■ , Pi^(O)). 

Step 2: Given Pi(r2), the SUs allocate the NE power according 
to dH) and ([5]) when the perfectly symmetric conditions can be 
satisfied in the 2-SU scenario. Otherwise, the SUs apply 
Algorithm 1 in the general scenario. Denote the allocated power 



for SUs as {Pi(n) = {Pl{n), ■ ■ ■ , Pl^ {n)) ] 
Step 3: Update PU's power by using , P({n + 1) 

(l-r/)P/H+ J-S^+fA 



where A is a constant to meet 



If {n)+N( 



E 



+ A 



Ifin)+N( 



N 

/=1 



A 



< Pi 



< Pi 



I.e., 



-E 



N 



If{n)+N( 

and G (0, 1) is a fixed step-size. 
Step 4: n = n + 1, go to Step 2 until convergence. 



14 
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pmax > iHn) assui^gj (^is paper. 
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Algorithm 3: Asynchronous Joint Iterative Distributed Power 
Allocation Algorithm for PU and SUs (single-PU multi-SU) 

Step h n = 0,k = l, initialize Pi(0) = (Pi^O), ■ ■ ■ , Pi^(O)) and 
{P,(0) = (P/(0),--- ,/^^(0))}^^,, Pi(0) and {P.(0)W 
satisfy their respective total power constraints and the 
ISR constraint. 

Step 2: Given Pi(n), the SUs update power allocation 
{Pi{n + 1) = (p/(n + 1), ■ ■ ■ , P^^in + 1)) }^^^ according to 
dH) and ^ in the 2-SU scenario when the perfectly symmetric 
conditions can be satisfied. Otherwise 

P/{n + 1) = BR, (p/(n), P/,h) 

for every i E E> and f = 1, ■ ■ ■ , N. 

Step 3: Let {r^}^^ be a subsequence of {nj'^^Q with 

Tfc+i — Tjt < oo for finite k. 

The PU updates its power asynchronously by 

pf{n + 1) = 

[ {l-6)P{{n)+6 

I n = Tk; 
y P/(n), otherwise. 

/ = 1, 2, ■ ■ ■ , A^, where 5 E (0, 1) is the fixed step size. 
If n = Tk, k = k + 1. 

Step 4: n = n + 1, go to Step 2 until convergence ox n = 
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Fig. 1. Power allocation of the SUs by using Algorithm 1 in the perfectly symmetric channel case, there are 3 sub-carriers 
and PU's power is Pi = [7 1 3]. 
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Fig. 2. Convergence performance of Algorithm 2 and Algoritlim 3 witii convergence performance of Algoritlim 2 and 
Algoritlim 3 witfi different channel parameters. Channel parameters 1: fei2 ~ CN (0, [0.7 0.5 0.6]), hiz ~ CN{Q, [0.5 0.5 0.7]), 
h2i ~ CM{Q,[QA 0.5 0.6]), h'ix ~ CA^CO, [0.5 0.5 0.4]), ftas ~ CA/'(0, [0.5 0.5 0.5]), ^32 ~ CA^CO, [0.5 0.5 0.5]), 
/ill ~ CA/'(0, [1 1 1]), h22 ~ CA/'(0, [1 1 1]), h3'i ~ CA/'(0, [1 1 1]). Channel parameters 2: ftia ~ CN(Q, [0.4 0.5 0.6]), 
/i.13 ~ CAA(0, [0.5 0.5 0.3]), /i2i ~ CAA(0, [0.6 0.5 0.6]), ftai ~ CAA(0, [0.7 0.5 0.4]), /123 ~ CAA(0, [0.5 0.3 0.9]), 
/i32 ~ CA/'(0, [0.4 0.5 0.6]), /ill ~ CA/'(0, [2 2 2]), ^22 ~ CU{Q, [1 1 1]), /133 ~ CAA(0, [1 1 1]). 



4.6 r 



cc 4.4 



4.2 



r 



■ User 1 (PU) 



0.92 B 



0.9 A 



0.88 



0.86 L 




50 



50 



50 



100 
Iteration 



100 
Iteration 



100 
Iteration 



150 200 
User2l 



150 



200 



■ User 3 



150 



200 



Fig. 3. Convergence performance of Algorithm 2 with step-size ?7 = 0.1 
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Fig. 4. Convergence performance of Algorithm 2 with step-size rj = 0.9 
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Fig. 5. Convergence performance of Algorithm 3 with step-size S = 0.1 
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Fig. 6. Convergence performance of Algorithm 3 with step-size S = 0.9 




Fig. 7. The rate performance of the analytical power allocation and iterative power allocation in the perfectly symmetric channel 
with different Pi'"^'=. The other parameters are: iV = 3, iVi = iV2 = iVa = [0.5 0.5 0.5], p = 0.1, Pa""" = 5, Pr""" = 1, 
ftii ~ CJV{0, [1 1 1]), h22 = /133 ~ CJV{0, [1 1 1]), hi2 = his ~ CJV{0, [vfe ^/KS VO^]), hii ~ CJV{0, [0.3 0.6 0.5]), 
hsi ~ CAA(0, [0.4 0.5 0.4]), /123 = /132 = 0.5 x h22 (i.e., c = 0.25). 
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Algorithm 4: Joint Iterative Distributed Power Allocation 
Algorithm for PUs and SUs (multi-PU and multi-SU) 

Step 1: 

n = 0, initialize Pi(0) = (P/(0), ■ ■ ■ , Pi^(O)), i E P. 
Step 2: 

Given {Pi(7^)}iGP, the SUs allocate the NE power according to 
(01) and ([5]) when the perfectly symmetric conditions can be 
satisfied in the 2-SU scenario. Otherwise, the SUs apply 
Algorithm 1 in the general scenario (Observe that P/|/i{ 

should be replaced by XlzeP-P/(^)I^Hp)- 
Denote the allocated power for SUs as 



P. 



N, 



n 



»} 



{PiW 
Step 3: 

Sub-step 3.1: k = 0, P,{k) = Pi{n) for all i G P. 

Sub-step 3.2: For every i G P, PU i updates its power by using 

P/{k + l) 



= {l-r^{)pf{k)+n, 
where l({k) = 



the total received interference, Aj is a constant to meet 
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and rji G (0, 1) is a fixed step-size. 

Sub-step 3.3: A; = A; + 1, go to Sub-step 3.2 until convergence. 
Sub-step 3.4: Pi{n + 1) = Pi{k) for i G P. 
Step 4: 



n 



n + 1, go to Step 2 until convergence or n = N„ 
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Fig. 8. Rate performance of the distributed iterative algorithm (Algorithm 4) for the multi-PU and multi-SU scenario 
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